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FOREWORD 


Few educational! innovations create such controversy within the profession 
as have accountability and performance contracting. Serving as an index of 
the interest these innovations have aroused is the large body of literature that 
has emerged in recent months to explain, assess, defend, and denounce the 
concepts. 


This analysis and bibliography has been prepared to analyze the major re- 
search ideas and trends reported in this literature. The analysis provides defi- 
nitions of accountability and performance contracting, surveys their causes, 
identifies supporters and critics, cites current projects, and discusses the issue 
of governance, the use of management systems and safeguards, the problems 
of measurement, and the legal aspects of performance contracting. 


The author, James R. Forsberg, is a third-year law student at the University 
of Oregon. He is employed by the Clearinghouse as a research analyst. 
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gk concept of accountability and one means 
of its implementation, performance contracting, are 
subjects of increasing debate within the educational 
community. While supporters justify and critics at- 
tack the concept, the demand grows for some way 
to measure the responsibility of educational mana- 
gers for the outcomes and products of educational 
systems. Legislators and taxpayers insist, for ex- 
ample, that programs must achieve what their ini- 
tiators claim they will achieve. 

Presently, the theory and application of accounta- 
bility is in a period of rapid development and 
change. New experiments are being conducted and 
refinements added as school districts decide to try 
some degree of accountability. As a result, the 
mainstream of the literature reflects a trial and 
error approach, but also reveals an increasing soph- 
istication in proposal requests and evaluations. 

In reviewing the literature concerning this innova- 
tive concept, this paper will gather definitions and 
dimensions of accountability and performance con- 
tracting, survey causes of and demands for accounta- 
bility, identify supporters and critics, and cite cur- 
rent projects. Subjects covered include the issue of 
accountability and governance, the use of manage- 
ment systems and safeguards, the problems of 
measurement, and the legal aspects of performance 


contracting. ; 


Definitions and Dimensions 


A term classic in management theory but new to 
education, accountability is defined by Kruger 
(1970) as the responsibility to provide effective 
educational programs and to employ efficiently 
the resources allocated for this purpose. Rhodes 
(1970) considers accountability a goal-directed man- 
agement process that permits both the present and 
the desired operation of a school to be viewed from 
a common frame of reference, with priority placed 
on the learner. Accountability provides the means 
for dealing with process and product together. 

Probably the most well-known definition of 
accountability is that of Lessinger ({1970]), who 
calls it the product of the process of performance 
contracting (see below). In a 1971 publication Les- 
singer maintains that accountability helps to 
counter the Peter Principle that bureaucracy tends 
to be self-regulating, cut off from control and as- 
sessment by those outside it and, therefore, not 
accountable to the client or citizen. In contrast, 
accountability promotes competence and respon- 
siveness in a bureaucracy by reporting publicly, 
through the medium of an outside agency, an inde- 
pendent and continuous review of results promised 
by the bureaucracy. 

Under performance contracting a local educa- 
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tional agency contracts with private enterprise to 
achieve specific goals, within a specific period, 
for specific costs. According to Lessinger ({1970]), 
“At its most basic, it means that an agent, public 
or private, entering into a contractual agreement to 
perform a service will be held answerable for per- 
forming according to agreed-upon terms, within an 
established time period and with a stipulated use of 
resources and performance standards.” 

A performance contract has been interpreted by 
Estes (1971) as a procedure by which a school dis- 
trict contracts with a private firm for certain in- 
structional services, usually including reading or 
math programs, or both. Terms and conditions of 
the contract are such that the contractor receives a 
set compensation if designated pupils achieve speci- 
fied educational gains as a result of contractor- 
administered activities. If pupils do not meet the 
specifications, the contractor receives less reim- 
bursement and may even be penalized. If pupils 
exceed specifications, the contractor receives addi- 
tional reimbursement. 

According to Lessinger ([1970]), the purpose of a 
performance contract is to catalyze and foster in- 
stitutional reform within a school system. A major 
concept of performance contracting is the ‘‘turn- 
key” provision whereby methods, materials, and 
practices resulting from the contractor’s interven- 
tion can be incorporated in the regular operations 
of the school or school system. As yet there is little 
literature on the provision; however, most contracts 
now contain a “turnkey” clause. 

Performance contracting is representative of the 
approach that tries to foster accountability by relat- 
ing “input”? to “educational output” in a mean- 
ingful way. However, Lieberman (1970) warns that 
accountability should not be defined solely in terms 
of performance contracting. Another approach to 
accountability, he indicates, is to allow consumer 
choice of schools. The competition created by con- 
sumer choice would force schools to become more 
accountable or lose clientele. The voucher system 
represents this approach: parents are given a speci- 
fied sun of money and allowed to select, with cer- 
tain restrictions, the schools to which they send 
their children. 


Causes and Demands 


Educational accountability has many causes, a 
few of which are briefly described here. The federal 
government has increasingly demanded accounta- 


bility for money issued under its programs, such as 
Titles I] and VIII of the Eiementary and Secondary 
Education Act of 1965. For example, Title VIII's 
Dropout Prevention Program provided the impetus 
and funding for the Texarkana contract and a num- 
ber of succeeding contracts. The Model Cities Pro- 
gram has also provided funding for contracts. An- 
other cause of the federal government’s insistence 
on accountability is the increasing emphasis on 
evaluation and assessment, as evidenced by the 
National Assessment Program. 

The demands of the disadvantaged for adequate 
education and the trends toward decentralization 
and community control place additional pressure 
on educators to focus on the outputs of the educa- 
tional system. Finally, increased sophistication in 
evaluation and management systems, together with 
more accurate measuring devices, have made it 
feasible to relate inputs to outputs. 


Supporters and Critics 


Leon M. Lessinger and Charles L. Blaschke are 
considered by some as creators of the concept of 
educational accountability and performance con- 
tracting. Other strong supporters include: 


1. congressmen, federal administrators, govern- 
ors, and state legislators, who demand evi- 
dence of educational outputs for dollar in- 
puts 

. corporations in the growing educational in- 
dustrial complex, who want an opportunity 
to demonstrate their new teaching materials 
and techniques and hope that lessons learned 
in performance contract experiments will 
lead to more profitable contracts 

. administrators of inner-city schools and 
school board members and associations, who 
are anxious to find ways of more efficiently 
using diminished funds to satisfy their 
constituencies 
minority groups and other disadvantaged 
groups, who demand that their children be 
educated to a minimal level of competency 
and that schools remedy the causes of high 
and accelcrating dropout rates 


Among the critics and skeptics is Edith Green, 
an influential congresswoman from Oregon and a 
former teacher. She objects to the overemphasis on 
skills inherent in an accountability project and be- 
lieves there are too many external environmental 


and health factors beyond the teacher’s control to 
hold a teacher responsible for outcomes. She also 
distrusts the motives and abilities of the educa- 
tional industrial complex. Bob Bhaerman and the 
American Federation of Teachers (AFT), Helen 
Bain and the National Education Association(NEA), 
and local teacher associations have also criticized 
accountability for reasons discussed below. 


Current Projects 


Hall and Stucker (1971) note the diversity of 
programs in operation. Programs may differ in the 
content of the educational programs in the portions 
of the programs under contract in the contract 
terms and in the characteristics of the contractors’ 
learning programs. Few contracts go beyond read- 
ing and math skills because of the problems in 
measuring achievement in other areas of learning. 

Hall and Stucker classify the programs in four 
groups. The first group contains the 1969-70 pro- 
grams. The second comprises the 1970-71 programs 
for student achievement. The third contains pro- 
grams unique for their concern with the education 
of teachers rather than with the education of stu- 
dents. The final group contains programs in the 
structured experiment being conducted by the 
United States Office of Economic Opportunity. 

Projects range from the controversial Texarkana 
project to the Gary, Indiana, school district, which 
contracted a whole school to Behavioral Research 
Laboratories. 

A comprehensive listing of current projects in- 
volving performance contracting is provided by Hall 
and Stucker, and another by the New York State 
Education Department (1970). 


Accountability and Governance 


One of the first questions asked is, “Who will be 
held accountable?” At least three answers to this 
question can be found in the literature, depending 
on which of three groups the writer belongs to. 
Teacher associations as a group demand various de- 
grees of governance or decision-making in policy 
matters before they will accept accountability. An- 
other group focuses on the school level and would 
hold the principal responsible. Yet a third group is 
researching to develop models and methods for de- 
termining the effects of various inputs by parents, 
administrators, and teachers on specified educa- 
tional outputs. 


Representing the first group, Harland (1970) has 
capsulized the views of the NEA in its demand 
that governance precede accountability. The NEA 
requests self-governance in such areas as the right of 
the teaching profession to approve programs, issue 
licenses, enforce standards of ethics and practices, 
promote studies and research designed to improve 
teacher education, and in general delegate responsi- 
bilities concomitant with accountability. This parti- 
cipation in decision-making, Harland argues, would 
remove the reluctance of the profession to being 
held responsible. 

The AFT has opposed both accountability and 
performance contracting. Bhaerman (1970), in his 
critique of Lessinger’s views, states that teachers 
have not been made sufficiently aware of new tech- 
nology and materials, nor have they been given ade- 
quate preservice and inservice training. He proposes 
that strengths and weaknesses of teachers be iden- 
tified so that continuous growth experiences can be 
provided. 

Another facet of the question of governance is 
brought up by Wilson (1971) in a discussion of the 
views of the American Association of Classroom 
Teachers (ACT), which stresses the right of teachers 
to speak on matters relating to curriculum and in- 
struction. Although school boards have the right to 
set policy, the ACT maintains that development 
and implementation of policy remain the respon- 
sibility of professionals and their organizations. 
Wilson delineates specific matters for which teach- 
ers should be held responsible and insists that class- 
room teachers, through their professional associa- 
tions, should be involved in decision-making pro- 
cesses in performance contracts. 

In some instances teacher organizations are work- 
ing closely with contractors and administrators on 
various programs. The Chicago Model Cities Pro- 
gram involves the Chicago Teachers Union in what 
it calls the Performance Contract Management Com- 
mittee, an overall management group of administra- 
tors and community organizations engaged in pre- 
planning and long-range planning. The Dallas Pro- 
ject (Estes 1971) uses a similar group called the 
Planning Advisory Group. Albert Shanker of the 
New York United Federation of Teachers has 
agreed to develop, with the New York City Buard 
of Education, objective criteria of professional 
responsibility. 

English and Zaharis (1971) offer an alternative 
to teacher association objections by suggesting that 
accountability and governance are incompatible 
since the increase in teacher power at the bargain- 
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ing table restricts the ability of the public to hold 
teachers accountable. In the authors’ view, the 
solution is internal contracting, such as the system 
now in progress at Mesa, Arizona, where teams of 
teachers contract with the school board for services. 

Meade (1968) is representative of the second 
group, which holds the school principal responsible. 
He maintains that there has been a shift away from 
holding individual staffs and schools responsible for 
their effect on educational outcomes. Those who 
propose this theory compare the principal to an 
industrial plant manager who is responsible for all 
that goes on in his plant. 

The third group attempting to assign responsibil- 
ity are researchers who develop methods and 
models relating input variables to specific outputs. 
Barro (1970), for example, has written a sophisti- 
cated analysis of the information and methodology 
required to determine the extent to which teachers 
or administrators can affect outcomes within their 
own spheres of responsibility, given the environ- 
ments in which they must work and the constraints 
placed on them. He recommends statistical analy- 
sis of the effects on a pupil’s progress in a given 
classroom of such variables as ethnicity, socioeco- 
nomic status, and prior educational experience. 
Barro’s methodology for measuring the individual 
agent’s contributions to pupil performance is a mul- 
tiple regression analysis of the relationship between 
pupil performance and an array of pupil, teacher, 
and school characteristics. 

Dyer (1970), on the other hand, emphasizes not 
individual contributions, but the joint responsibility 
of the entire school staff. He advocates recognizing 
and measuring four school variables: input, educa- 
tional process, surrounding conditions, and output. 
These variables must be measured and appropriately 
interrelated and combined to produce readily inter- 
pretable indices by which the staff can know to 
what degree its own efforts produce the desired 
changes in pupils. He calls such indices School Ef- 
fectiveness Indices (SEIs) and describes their deri- 
vation, suggesting short- and long-range plans for 
operation. 


Management Systems and Safeguards 


Accountability systems and performance con- 
tracting have drawn on the theory and applications 
of management systems, systems approaches, sys- 
tems analysis, and evaluation procedurvs. Manage- 
ment support groups, a feature of most pertormance 


contracts, provide many of the management ser- 
vices required by a contract and supplement school 
staff management experience. Evaluators function 
as monitors by assisting in management and seeing 
that the instructional contractor meets specifica- 
tions. Additional safeguards are provided by inde- 
pendent audit teams, who verify that a contractor 
has met his contract guarantees. 

Kruger (1970) identifies ten critical factors of 
program design, operation, and management: com- 
munity involvement, technical assistance, needs as- 
sessment, management systems, performance ob- 
jectives, performance contracting, staff develop- 
ment, comprehensive evaluation, cost effectiveness, 
and program audit. 

Community involvement provides one of the 
more effective safeguards in an accountability pro- 
gram. Accordingly, community priorities and re- 
sources must be considered in both the planning 
and operating stages. Farquhar (1971) discusses 
the information systems needed to determine these 
priorities and resources and also to keep the public 
informed of the performance of the program. Ina 
work published soon after the adoption of the 
Model Cities Act, Campbell, Marx, and Nystrand 
(1969) discuss the importance of community in- 
volvement in model cities projects. Both the Chi- 
cago and the Dallas performance contracts involve 
community groups in planning procedures. 

Describing evaluation as one of the most impor- 
tant aspects of a performance contract or accounta- 
bility program, Kruger urges that an evaluation plan 
be made prior to the commencement of project 
operations, that the plan have adequate scope, that 
it provide evaluation of objectives-accomplishments 
at both operational and management levels, and 
that, within these levels, it pay attention to product 
and process. The evaluator must be skilled in both 
educational evaluation and management operations 
analysis. 

Hall and Stucker (1971) recommend a broad per- 
spective to evaluate effects other than the narrow 
objectives listed for a performance contract, since 
there will likely be affective or volitional impacts 
on students and both positive and negative impacts 
on teachers and school officials. 

Andrew and Roberts’ (1970) evaluation report 
on the Texarkana project points out the errors and 
weaknesses of that experiment and provides a good 
example of the problems that may face an evalua- 
tor. One of the problems in that project was that 
the internal evaluator was hired after the project 
had begun. 
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Lessinger ({1970] ) has outlined the general func- 
tions of the various groups in a performance con- 
tract: 


¢ The local education agency (LEA) employs 
a management support group (MSG). 

¢ The MSG draws up a set of general specifi- 
cations called a request for proposal (RFP). 

e The RFP is the subject of a prebidding con- 
ference. 

e The LEA, with the aid of the MSG, selects 
the best bid and negotiates a performance 
contract. 

e The LEA empioys an independent audit 
team to monitor execution of the perfor- 
mance contract and to certify results for 
purposes of payments. 


Actual requests for proposals provide a clearer 
idea of the role of management support groups and 
independent auditors. (Chicago Board of Education 
1970, Texarkana School District 7 1970, and Estes 
1971). 


Measurement Problems 


Accountability presupposes some measure of in- 
puts and outputs. Because the evaluation of achieve- 
ment is no better than the measurement instru- 
ments used, the identification of appropriate instru- 
ments to measure the attainment of the objectives 
specified in the performance contract is essential. 
The instruments and systems used for measurement 
are critical, not only in determining the amount of 
the contract payments, but also in evaluating the 
conduct and effectiveness of the program. 

The instruments for measuring these outputs 
have generally been the standardized norm-refer- 
enced achievement tests for reading and mathemat- 
ics skills, together with their subtests. In his thought- 
ful analysis of the measurement process and prob- 
lems, Lennon (1971) questions the validity of the 
standard achievement tests, noting that these tests 
are concerned with a wider range of content and 
outcomes than the narrowly defined, specific areas 
of contract intervention. Moreover, achievement 
tests on reading skills do not correlate perfectly 
with one another and may even vary on subtest 
composition and relative emphases. Similar prob- 
lems exist in the mathematics tests. 

Another problem, reliability, involves the diffi- 
culty of measuring the gains of an individual 
pupil. Since the highest reliability of any test is 
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.90, the error of measurement of a gain score may 
very easily equal or exceed the amount of gain 
guaranteed in a short-term contract intervention. 
One solution Lennon offers is designing projects 
of longer duration. 

As an alternative or supplement to the norm- 
referenced test, Lennon suggests the use of criterion 
referenced tests. However, it is not yet clear how 
results of a series of criterion-referenced tests can 
be translated into units that will yield measures of 
gain or growth. Criterion-referenced tests have been 
recommended by other authors. Harmes (1971), for 
example, maintains that use of behavioral objec- 
tives increases the cptions for development of many 
different specific procedures, instead of limiting 
the process to one test or combination of uncor- 
related tests. Some requests for proposals are al- 
ready specifying a certain percent—usually 25 
percent—of the payment to be based on criterion- 
referenced test items taken from pools of items 
developed by the instructional contractor (Chicago 
Board of Education 1970, Texarkana School Dis- 
trict 7 1970). 

Byrd (1970) discusses current testing problems, 
including the time lag between events and curricular 
changes and new test construction, and the use of 
test results as a method of evaluation in accounta- 
bility. 

Andrew and Roberts (1970), the internal evalua- 
tors for the first Texarkana contract, describe that 
contract’s notorious problem of teaching test items. 
The effect of such teaching was to make evaluation 
of the contract meaningless. Although Educational 
Testing Service, the auditor for that contract, at- 
tempted to analyze the effects of teaching certain 
test items and hence salvage some meaningful 
evaluation, it did not succeed. To avoid this prob- 
lem, local education agencies use criterion-re- 
ferenced test items, to establish stricter pro- 
cedures for monitoring contracts in progress, and 
to cease telling instructional contractors what 
achievement tests or forms of those tests will 
be used. 


Legal Aspects 


Local education agencies desiring to draft perfor- 
mance contracts must obtain expert legal assistance 
to make sure the contracts are legally valid. A 
lawyer assisting in this drafting should be know- 
ledgeable in educational matters as well as in the 
law. 


Some legal offices serving boards of education 
have questioned the ability of school boards, under 
state constitutions and laws, to contract with out- 
side, private firms. For example, the counsel to the 
New York State Education Department has stated 
he does not believe boards of education in that state 
have authority to enter into agreements with third 
parties to provide instructional services in public 
schools (New York State Education Department 
1970). 

Martin and Blaschke (1971) divide the problem 
into two issues: the authority to contract and the 
improper delegation of policy-making powers. A 
school’s authority to contract may be limited if it 
is under a duty to perform a task imposed on it by 
constitutional declaration or statutory delegation. 
In such instances, an attempt to contract for the 
performance of this duty may be void. 

To decide the issue of improper delegation, the 
courts must determine what is within a board’s 
policy-making responsibility. There are indications 
the courts will construe this very strictly. To deter- 
mine if a school is improperly delegating policy 
matters, school districts should consider: (1) the 
degree of specificity on requests for proposals, (2) 
the sufficiency of expertise of the school staff or 
additional personnel hired to fulfill its monitoring 
and management function, and (3) the specificity 
of the period the contract is to run before it is 
abandoned or absorbed by the school. 


Future Trends in the Literature 


The literature on performance contracting may 
be expected to follow three differing trends. The 
first group, directed to decision-makers, will con- 
sist largely of evaluations of current projects and 
practical treatises on how to implement perfor- 
mance contracting or accountability in schools. 

The second group, written by theoreticians such 
as Barro and Dyer, will continue to develop meth- 
ods and means to determine the precise effect of 
inputs on pupil performance. Since research de- 
signs and methodologies are not yet sufficient to 
relate inputs to outputs with precision, temporary 
intermediate methods for evaluating teacher and ad- 
ministrator performance will be required. 

The third group, presenting views of various 
teacher associations, may be expected to attack both 
accountability and performance contracting with 
renewed vigor as current programs progress beyond 
the experimental stage to practical application. 
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The first of three reports in a comprehensive 
study of performance contracting sponsored by the 
United States Department of Health, Education, and 
Welfare has been published by The Rand Corpora- 
tion. The report is in two parts. In part 1, Stucker 
and Hall (1970) explore the basic issues in perform- 
ance contracting, addressing their discussion to edu- 
cation decision-makers. The second part (Stucker 
1971) is a technical appendix of mathematical 
models of interest mainly to theoreticians and mo- 
del builders. 

A later report will analyze the outcomes of some 
programs after 1970-71 results are available, and 
the final report will be a Performance Contracting 
Guide, combining concepts of the first report with 
conclusions drawn from program results in the sec- 
ond to produce a general guide on how to plan, 
conduct, and evaluate performance contracting 
programs. 


Conclusion 


Many writers are concerned that educational 
accountability and performance contracting will 
join the long list of innovations that have been 
debated with a great deal cf fanfare and then 
quietly discarded. Chandler (1971), noting this 
phenomenon, suggests that performance contracting 
can go one of two ways. Through abuses, ex- 
aggerated claims, unreliable evaluations, and un- 
ethical practices, performance contracting could 
end in disrepute. On the other hand, if performance 
contracting is carried out with patient, careful, 
and intelligent testing and experimentation, it 
could become a highly effective tool for education. 
The next few months may provide the answer. 

Even when well conceived and implemented, 
performance contracts are usually considered only 
temporary or stopgap devices to be used until 
schools can adopt the techniques and technology 
of the contractor through turnkeying. Consequently, 
as performance contracts are phased out, it may 
be expected that more attention will focus on 
the basic concept of accountability. If that stage is 
reached, the persons or groups who are held ac- 
countable may become vociferous in their dis- 
approval—as teacher associations threaten to do— 
if the accountability programs are not carefully 
planned and worked out with the affected groups. 
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